on the safe side

Avoiding danger, with a margin for error, as in Just to be on the safe side, let's order another hundred chairs. This idiom was first recorded in 1811.